Method of operating a navigation system using images

ABSTRACT

A method of operating a navigation system determines a route between an origin and a destination and provides a photographic image showing a geographic area through which the route passes. The photographic image shows the geographic area from a land-based viewpoint. The method overlays a route highlight on the photographic image identifying a path to be traveled. The route highlight includes a symbol indicating at least one feature of the route selected from a group consisting of handicap accessible route, tree-lined route, well-lit route, quiet route, scenic route, crowded route, peaceful route, and bicycle friendly route.

REFERENCE TO RELATED APPLICATIONS

The present application is a continuation of application Ser. No.12/879,178 filed on Sep. 10, 2010, which is a continuation ofapplication Ser. No. 12/253,488, now U.S. Pat. No. 7,818,124, filed onOct. 17, 2008, which was a continuation of application Ser. No.10/880,815, now U.S. Pat. No. 7,460,953, filed on Jun. 30, 2004, whichwas related to the applications: application Ser. No. 10/881,310, nowU.S. Pat. No. 7,149,626, filed Jun. 30, 2004, application Ser. No.10/881,312, now U.S. Pat. No. 7,266,447, filed on Jun. 30, 2004,application Ser. No. 10/880,660, now U.S. Pat. No. 7,421,341, filed onJun. 30, 2004, application Ser. No. 10/881,660 filed on Jun. 30, 2004,and application Ser. No. 10/880,816 filed on Jun. 30, 2004, the entiredisclosures of which are incorporated by reference herein.

BACKGROUND OF THE INVENTION

The present invention relates to a method and system for providingnavigation features and functions, and more particularly to a method andsystem for collecting images and providing navigation features using theimages.

Vehicle navigation systems are available that provide end users withvarious navigation-related functions and features. For example, somenavigation systems are able to determine an optimum route to travelalong a road network from an origin location to a destination locationin a geographic region. Using input from the end user, and optionallyfrom equipment that can determine the end user's location (such as a GPSsystem), the navigation system can examine various potential routesbetween the origin and destination locations to determine the optimumroute. The navigation system may then provide the end user withinformation about the optimum route in the form of guidance thatidentifies the driving maneuvers for the end user to travel from theorigin to the destination location. The guidance may take the form ofvisual and/or audio instructions that are provided along the way as theend user is traveling the route. Some navigation systems are able toshow detailed maps on displays outlining the route, the types ofmaneuvers to be taken at various locations along the route, locations ofcertain types of features, and so on.

In order to provide these and other navigation-related functions andfeatures, navigation systems use geographic data. The geographic datamay be in the form of one or more geographic databases that include datarepresenting physical features in the geographic region. The geographicdatabase includes information about the represented geographic features,such as the positions of the roads, speed limits along portions ofroads, address ranges along the road portions, turn restrictions atintersections of roads, direction restrictions, such as one-way streets,and so on. Additionally, the geographic data may include points ofinterest, such as restaurants, hotels, airports, gas stations, stadiums,police stations, and so on.

Although navigation systems provide many important features, therecontinues to be room for new features and improvements. One area inwhich there is room for improvement relates to providing improvedguidance for following the route. In some situations, additionalguidance and orientation information would be helpful when following theroute. For example, some areas may be difficult for a user of anavigation system 100 to traverse because of the many road segmentsintersecting in the area and the many different turn options availableto travel. Additionally, pedestrians may find additional guidance andorientation information helpful when traversing a route becausepedestrians have a greater degree of freedom of motion and may becomemore frequently confused as to their orientation to destination.

Accordingly, it would be beneficial to have a way to collect and provideimages that may be used to provide improved navigation-related functionsand features.

SUMMARY OF THE INVENTION

A method and system of operating a navigation system is described in theembodiments disclosed herein. The method provides an image of ageographic area through which a portion of a route between an origin anddestination passes. The image may be an approximate 360-degree image.The image may include a guidance information overlay on the image, suchas a route highlight, a maneuver arrow, an indication of a path that hasbeen traveled, a main route and alternative route, and a label. Theimages with the guidance information overlays may orient and provideguidance to the user of the navigation system.

In another embodiment, the method of operating a navigation systemprovides an image of a geographic region and overlays the image withlabels identifying locations in the image. The method enables a user ofthe navigation system to enter one of the locations and provides anavigation feature for the entered location. The image may be asingle-view photograph or a panoramic photograph. The locationsidentified with labels may be points of interests.

BRIEF DESCRIPTION OF THE DRAWINGS

An exemplary embodiment of the present invention is described hereinwith reference to the drawings, in which:

FIG. 1 is a block diagram of a navigation system, according to anexemplary embodiment;

FIG. 2 illustrates a map of a geographic region;

FIG. 3 is a block diagram of a geographic database included in thenavigation system depicted in FIG. 1, according to an exemplaryembodiment;

FIG. 4 is a block diagram of road segment data records and node datarecords contained in the geographic database depicted in FIG. 3,according to an exemplary embodiment;

FIG. 5 is a block diagram of pedestrian segment data records andorientation node data records contained in the geographic databasedepicted in FIG. 3, according to an exemplary embodiment;

FIG. 6 is a 360-degree panoramic image of an intersection;

FIG. 7 is a flow chart for collecting image data, according to anexemplary embodiment;

FIG. 8 is a flow chart for coding the image for guidance informationoverlays;

FIG. 9 is an image depicting coding for guidance information overlays;

FIG. 10 is a block diagram of image data records, according to anexemplary embodiment;

FIG. 11 is a flow chart for using images to provide guidance, accordingto an exemplary embodiment;

FIG. 12 is a 360-degree panoramic image depicting the use of guidanceinformation overlays, according to an exemplary embodiment;

FIG. 13 is a pictorial representation of overlay dot size used in theguidance information overlays, according to an exemplary embodiment;

FIG. 14 is an image depicting the use of the guidance informationoverlays, according to another exemplary embodiment;

FIG. 15 is an image depicting the use of the guidance informationoverlays, according to another exemplary embodiment;

FIG. 16 is a screen shot depicting the use image with guidanceinformation overlay as provided by the navigation system depicted inFIG. 1, according to an exemplary embodiment;

FIG. 17 is a screen shot of an image with guidance information overlayand a textual guidance message provided by the navigation systemdepicted in FIG. 1, according to an exemplary embodiment;

FIG. 18A is a screen shot of an image with guidance information overlayand a touch-screen icon for requesting a guidance message as provided bythe navigation system depicted in FIG. 1, according to an exemplaryembodiment;

FIG. 18B is a screen shot of a guidance message and a touch-screen iconfor requesting an image with guidance information overlay as provided bythe navigation system depicted in FIG. 1, according to an exemplaryembodiment; and

FIG. 19 is an image including label overlays provided by the navigationsystem depicted in FIG. 1, according to an exemplary embodiment.

DETAILED DESCRIPTION OF THE PRESENTLY PREFERRED EMBODIMENTS

I. Navigation System

FIG. 1 is a block diagram of a navigation system 100 associated with acomputing platform 102, such as a personal digital assistant (PDA),mobile telephone or any computer, according to an exemplary embodiment.The navigation system 100 is a combination of hardware and softwarecomponents. In one embodiment, the navigation system 100 includes aprocessor 104, a drive 106 connected to the processor 104, and anon-volatile memory storage device 108 for storing navigationapplication software programs 110 and possibly other information.

The navigation system 100 also includes a positioning system 112. Thepositioning system 112 may utilize GPS-type technology, a deadreckoning-type system, or combinations of these or other systems, all ofwhich are known in the art. The positioning system 112 may includesuitable sensing devices that measure the traveling distance speed,direction, orientation and so on. The positioning system 112 may alsoinclude a GPS system. The positioning system 112 outputs a signal to theprocessor 104. The navigation application software programs 110 that runon the processor 104 use the signal from the positioning system 112 todetermine the location, direction, orientation, etc., of the computingplatform 102.

The navigation system 100 also includes a user interface 114 that allowsthe end user to input information into the navigation system 100 andobtain information from the navigation system 100. The input informationmay include a request for navigation features and functions of thenavigation system 100. In one embodiment, information from thenavigation system 100 is provided on a display screen of the userinterface 114. To provide navigation features and functions, thenavigation system 100 uses a geographic database 116 stored on a storagemedium 118. In one embodiment, the storage medium 118 is installed inthe drive 106 so that the geographic database 116 can be read and usedby the navigation system 100. In one embodiment, the geographic database116 may be a geographic database published by NAVTEQ North America, LLCof Chicago, Ill. The storage medium 118 and the geographic database 116do not have to be physically provided at the location of the navigationsystem 100. In alternative embodiments, the storage medium 118, uponwhich some or the entire geographic database 116 is stored, may belocated remotely from the rest of the navigation system 100 and portionsof the geographic data provided via a communications system 120, asneeded.

In one exemplary type of system, the navigation application softwareprograms 110 load from the non-volatile memory storage device 108 into arandom access memory (RAM) 122 associated with the processor 104. Theprocessor 104 also receives input from the user interface 114. Thenavigation system 100 uses the geographic database 116 stored on thestorage medium 118, possibly in conjunction with the outputs from thepositioning system 112 and the communications system 120, to providevarious navigation features and functions. The navigation applicationsoftware programs 110 may include separate applications (or subprograms)that provide the various navigation-related features and functions. Thenavigation functions and features may include route calculation 124(wherein a route from an origin to a destination is determined), routeguidance 126 (wherein detailed directions are provided for reaching adesired destination), map display 128, and positioning 130 (e.g., mapmatching).

Other functions and programming 132 may be included in the navigationsystem 100. The navigation application software programs 110 may bewritten in a suitable computer programming language such as C, althoughother programming languages, such as C++ or Java, are also suitable. Allof the components described above may be conventional (or other thanconventional) and the manufacture and use of these components are knownto those of skill in the art.

II. Geographic Database

In order to provide navigation-related features and functions to the enduser, the navigation system 100 uses the geographic database 116. Thegeographic database 116 includes information about one or moregeographic regions. FIG. 2 illustrates a map 200 of a geographic region202. The geographic region 202 may correspond to a metropolitan or ruralarea, a state, a country, or combinations thereof, or any other area.Located in the geographic region 202 are physical geographic features,such as roads, points of interest (including businesses, municipalfacilities, etc.), lakes, rivers, railroads, municipalities, etc.

FIG. 2 also includes an enlarged map 204 of a portion 206 of thegeographic region 202. The enlarged map 204 illustrates part of a roadnetwork 208 in the geographic region 202. The road network 208 includes,among other things, roads and intersections located in the geographicregion 202. As shown in the portion 206, each road in the geographicregion 202 is composed of one or more road segments 210. A road segment210 represents a portion of the road. Each road segment 210 is shown tohave associated with it two nodes 212; one node represents the point atone end of the road segment and the other node represents the point atthe other end of the road segment. The node 212 at either end of a roadsegment 210 may correspond to a location at which the road meets anotherroad, i.e., an intersection, or where the road dead-ends. Also includedin the portion 206 of the geographic region 202 are paths or a pathnetwork (not shown) that may be traversed by pedestrians, such as in apark or plaza.

Referring to FIG. 3, the geographic database 116 contains data 302 thatrepresents some of the physical geographic features in the geographicregion 202 depicted in FIG. 2. The data 302 contained in the geographicdatabase 116 includes data that represent the road network 208. In theembodiment of FIG. 3, the geographic database 116 that represents thegeographic region 202 contains at least one road segment database record304 (also referred to as “entity” or “entry”) for each road segment 210in the geographic region 202. The geographic database 116 thatrepresents the geographic region 202 also includes a node databaserecord 306 (or “entity” or “entry”) for each node 212 in the geographicregion 202. The terms “nodes” and “segments” represent only oneterminology for describing these physical geographic features, and otherterminology for describing these features is intended to be encompassedwithin the scope of these concepts. In one embodiment, the geographicdatabase 116 that represents the geographic region 202 also contains atleast one pedestrian segment database record 308 for each pedestriansegment in the geographic region 202 and orientation node databaserecord 310 for each orientation node in the geographic region 202.Pedestrian segments and orientation nodes are associated with paths thatmay be traversed by pedestrians, such as in the park or plaza. A moredetailed description of pedestrian segments and orientation nodes may befound in the application entitled “METHOD OF COLLECTING INFORMATION FORA GEOGRAPHIC DATABASE FOR USE WITH A NAVIGATION SYSTEM” filed on thesame date herewith, U.S. Pat. No. 7,266,447, the entire disclosure ofwhich is incorporated by reference herein.

The geographic database 116 may also include other kinds of data 312.The other kinds of data 312 may represent other kinds of geographicfeatures or anything else. The other kinds of data may include point ofinterest data. For example, the point of interest data may include pointof interest records comprising a type (e.g., the type of point ofinterest, such as restaurant, hotel, city hall, police station,historical marker, ATM, golf course, etc.), location of the point ofinterest, a phone number, hours of operation, etc. The geographicdatabase 116 also includes indexes 314. The indexes 314 may includevarious types of indexes that relate the different types of data to eachother or that relate to other aspects of the data contained in thegeographic database 116. For example, the indexes 314 may relate thenodes in the node data records 306 with the end points of a road segmentin the road segment data records 304. As another example, the indexes314 may relate point of interest data in the other data records 312 witha road segment in the segment data records 304.

FIG. 4 shows some of the components of a road segment data record 304contained in the geographic database 116. The road segment data record304 includes a segment ID 304(1) by which the data record can beidentified in the geographic database 116. Each road segment data record304 has associated with it information (such as “attributes”, “fields”,etc.) that describes features of the represented road segment. The roadsegment data record 304 may include data 304(2) that indicate therestrictions, if any, on the direction of vehicular travel permitted onthe represented road segment. The road segment data record 304 includesdata 304(3) that indicate a speed limit or speed category (i.e., themaximum permitted vehicular speed of travel) on the represented roadsegment. The road segment data record 304 may also include data 304(4)indicating whether the represented road segment is part of a controlledaccess road (such as an expressway), a ramp to a controlled access road,a bridge, a tunnel, a toll road, a ferry, and so on.

The road segment data record 304 also includes data 304(6) providing thegeographic coordinates (e.g., the latitude and longitude) of the endpoints of the represented road segment. In one embodiment, the data304(6) are references to the node data records 306 that represent thenodes corresponding to the end points of the represented road segment.

The road segment data record 304 may also include or be associated withother data 304(7) that refer to various other attributes of therepresented road segment. The various attributes associated with a roadsegment may be included in a single road segment record, or may beincluded in more than one type of record that cross-references to eachother. For example, the road segment data record 304 may include dataidentifying what turn restrictions exist at each of the nodes whichcorrespond to intersections at the ends of the road portion representedby the road segment, the name or names by which the represented roadsegment is known, the street address ranges along the represented roadsegment, and so on.

FIG. 4 also shows some of the components of a node data record 306contained in the geographic database 116. Each of the node data records306 may have associated information (such as “attributes”, “fields”,etc.) that allows identification of the road segment(s) that connect toit and/or it's geographic position (e.g., its latitude and longitudecoordinates). For the embodiment shown in FIG. 4, the node data records306(1) and 306(2) include the latitude and longitude coordinates306(1)(1) and 306(2)(1) for their node. The node data records 306(1) and306(2) may also include other data 306(1)(3) and 306(2)(3) that refer tovarious other attributes of the nodes.

FIG. 5 shows some of the components of a pedestrian segment data record308 contained in the geographic database 116. The pedestrian segmentdata record 308 includes a segment ID 308(1) by which the data recordcan be identified in the geographic database 116. Each pedestriansegment data record 308 has associated with it information (such as“attributes”, “fields”, etc.) that describes features of the representedpedestrian segment. The pedestrian segment data record 308 may includedata 308(2) that indicate a type of pedestrian segment, such as virtualpedestrian path, paved pedestrian path, unpaved pedestrian path,sidewalk, alley, indoor path. The pedestrian segment data record 308includes data 308(3) that indicate a phrase ID and data indicating asegment name 308(4) which together provide a text description of thepedestrian segment. The data indicating the phrase ID provides apredetermined phrase that accompanies the segment name to describe thepedestrian segment. The pedestrian segment data record 308 may alsoinclude applicable direction data 308(5) indicating whether direction oftravel on the pedestrian segment affects how the pedestrian segmentshould be described, and if so, the direction of travel associated withthe above data.

The pedestrian segment data record 308 also includes data 308(7)relating to the end points of the represented pedestrian segment. Theendpoint data includes data 308(7) include references 308(7)(1) to theorientation node data records 310 that represent the orientation nodescorresponding to the end points of the represented pedestrian segment.The pedestrian segment data record 308 may also include or be associatedwith other data 308(8) that refer to various other attributes of therepresented pedestrian segment. The various attributes associated with apedestrian segment may be included in a single pedestrian segmentrecord, or may be included in more than one type of record thatcross-references to each other.

FIG. 5 also shows some of the components of an orientation node datarecord 310 contained in the geographic database 116. Each orientationnode data record 310(1) and 310(2) include a node ID 310(1)(1) and310(2)(1) by which the data record can be identified in the geographicdatabase 116. Each of the orientation node data records 310 may haveassociated information (such as “attributes”, “fields”, etc.) thatallows identification of the pedestrian segment(s) that connect to itand/or it's geographic position (e.g., its latitude and longitudecoordinates). For the embodiment shown in FIG. 5, the orientation nodedata records 310(1) and 310(2) include the latitude and longitudecoordinates 310(1)(2) and 310(2)(2) for their node.

Each orientation node data record also includes data indicating anorientation node name 310(1)(3) and 310(2)(3). Each orientation nodedata record also includes connection data 310(1)(5) and 310(2)(5)indicating connection, if any, to the road network. In one embodiment,the connection data 310(1)(5) and 310(2)(5) are references to the roadsegment data records 304 and/or road network node data records 306 thatrepresent the road segments and nodes that connect with the orientationnode. The node data records 310(1) and 310(2) may also include otherdata 310(1)(6) and 310(2)(6) that refer to various other attributes ofthe nodes.

III. Collecting Images

Referring to FIG. 1, the navigation system 100 provides variousnavigation-related features and functions including route guidance 126.Route guidance 126 provides a user of the navigation system 100 withdetailed directions for reaching a desired destination. In oneembodiment, the directions include maneuver instructions at specifiedintersections.

Some areas within the geographic region 202 may be difficult to traverseeven with the detailed directions from the conventional route guidancefeature 126. FIG. 6 is a 360-degree panoramic image 600 of PiccadillyCircus in London, England. Piccadilly Circus is an example of an areathat may be difficult for a user of a navigation system 100 to traversebecause of the many road segments intersecting in the area and the manydifferent turn options available to travel. Additionally, a pedestrianmay have difficulty traversing some areas, such as Piccadilly Circus,because the pedestrian has a greater freedom of movement as a vehicle.The pedestrian does not have direction restrictions as a vehicle; thepedestrian can walk down a one-way street in both directions. Moreover,the pedestrian may become more frequently confused as to direction oftravel and orientation.

To allow the navigation system 100 to provide improved route guidance, ageographic database developer collects image data of road segments, roadnodes or intersections, pedestrian segments, orientation nodes and anyother geographic feature. In one embodiment, a geographic researchertravels the geographic region to collect image data. In anotherembodiment, the geographic researcher obtains image data from othersources, such as an image repository.

FIG. 7 is a flow chart for collecting image data in the geographicregion 202, according to an exemplary embodiment. At step 700, theresearcher identifies an area of the geographic region appropriate forcollecting image data. In one embodiment, the area appropriate forcollecting image data is a confusing intersection. In anotherembodiment, the areas appropriate for collecting image data are decisionpoints along a road or pedestrian network at which the user of thenavigation system 100 has an option of turning. In other embodiments,the area appropriate for collecting image data may be any intersection,road segment, pedestrian segment, orientation node, scenic view, pointof interest, such as a business or facility, or any other geographicfeature. In another embodiment, the researcher collects a series ofimages along the road and/or pedestrian segments to enable a user toobtain a continuous visual representation of a route or a visualrepresentation of a significant portion of the route.

At step 702, the researcher captures a photographic image of the area.The certain geographic areas, images may be taken during the day and atnight. Additionally, it may be more desirable to capture the image whenthe weather is dry to obtain clear photographs. Further, the photographsmay be taken when the area is empty, so that cars and pedestrians do notobscure the view.

In one embodiment, the geographic researcher uses a digital camera, avideo camera, a film camera or any other device to obtain the images.The images may be a single view, 180-degree view, a 360-degree panoramicview, such as the 360-degree panoramic image 600 of FIG. 6, or any othertype of image. In one embodiment, the 360-degree panoramic image may betaken by using a camera designed to take 360-degree panoramicphotographs. For example, the camera may have a fisheye/180/360 degreecamera lens. Alternatively, the 360-degree panoramic image may bestitched together from a series of single view images showing a sectionof the 360-degree view as known to one skilled in the art. Aftercapturing the images, the images are digitally stored in a memorydevice.

At step 704, the researcher records a location associated with theimage. In one embodiment, the researcher records a position of thelocation from which the image was captured. In another embodiment, theresearcher records the position and/or name of a geographic featurewithin the captured image, such as an intersection, road segment,building or any other feature. In a further embodiment, the researcherrecords the position and/or name of a geographic feature proximate thelocation from which the image was captured. The research may use apositioning system to determine the location. The positioning system maybe the same or a different system as the positioning system 112 depictedin FIG. 1. The positioning system may utilize GPS-type technology, adead reckoning-type system, or combinations of these or other systems,all of which are known in the art. The positioning system may includesuitable sensing devices that measure the traveling distance speed,direction, and so on, of the system. The positioning system may alsoinclude appropriate technology to obtain a GPS signal, in a manner thatis known in the art. The positioning system may provide as an output thelatitude and longitude of the location at which the image was captured.In addition, maps and aerial images of the area may be used to determinethe position associated with the captured image. The researcher mayrecord the position information and any other information associatedwith the image using any data collection method, such as handwriting,voice recording and data entry into a user device.

At step 706, the researcher records a direction associated with thecaptured image. In one embodiment, the direction associated with thecaptured image is a direction in which the camera was facing when theimage was captured. The researcher may determine the direction of theview using general knowledge, a compass, the positioning system or anyother method of determining direction. In another embodiment, thedirection associated with the image references a geographic featurecaptured in the image, such as along a road segment or at a building.

At step 708, the image is cross-referenced with at least one geographicfeature. In one embodiment, the image is cross-referenced with aroad-network node and/or a pedestrian orientation node. In anotherembodiment, the image is associated with a road segment, pedestrianssegment and/or a position along a road segment or pedestrian segment. Ina further embodiment, the image is associated with a point of interest,such as a building, business, restaurant, hotel, city hall, policestation, historical marker, ATM or any other type of point of interestor any other geographic feature. The researcher may cross-reference theimage with at least one of the geographic features by recording thegeographic feature when capturing the image. Alternatively, thelocation, such as latitude and longitude coordinates, may be geo-codedto identify a geographic feature in the geographic database 116 inproximity to the location associated with the image.

At block 710, the image is coded for guidance information overlays, suchas a path, a specific maneuver, a direction of travel, a label or anyother overlay. FIG. 8 below describes coding the image for guidanceinformation overlays according to one embodiment. At step 712, the imageand associated data are stored in the geographic database 116 as will bedescribed in more detail below. In alternative embodiments, the stepsfor collecting image data are performed in a different order thanpresented in FIG. 7. Additionally, a geographic researcher traveling thegeographic region may perform some of the above steps of FIG. 7, whileanother geographic researcher at a central base station may perform theremaining steps of FIG. 7.

FIG. 8 is a flow chart for coding the image for guidance informationoverlays according to one embodiment. Some of the steps of FIG. 8 willbe illustrated with the image 900 of FIG. 9. At step 800, the researcheridentifies a control point 902 for the image 900. In one embodiment, thecontrol point 902 indicates a direction, such as north, in the image900. In another embodiment, the control point 902 indicates a locationat which the image was captured. At step 802, the researcher determinesa line-of-sight associated with the captured image. The line-of-sightassociated with the captured image is a distance that can be seen in theimage 900, such as 20 meters. The line-of-sight may be calculated usingstandard Geographic Information Systems (GIS) software. Alternatively,the line-of-sight calculation may be performed using Digital ElevationModels (DEM). The line-of-sight may be limited by obstructions in theview, such as buildings and trees.

At step 804, the researcher identifies geographic features in the image900. In one embodiment, road segments, nodes or intersections,pedestrian segments, pedestrian orientation nodes are identified.Additionally, any feature present in the image may be identifiedincluding lakes, rivers, railroads, municipalities, points of interest,such as buildings, businesses, restaurants, stores, hotels, municipalfacilities, historical markers, ATMs, golf courses, water fountains,statues, bike racks, etc. For the image 900 in FIG. 9, the researcherwould identify the paved pedestrian segments 904, pedestrian orientationnodes 906 at the intersections of the pedestrian segments and a statue908.

At step 806, the researcher creates guide points 910 and label points912 on the image 900. The guide points 910 are located at positions onthe image 900 that correspond to locations at which guidance typeinformation may be overlaid on the image 900. For example, guide points910 may be located to correspond with road segments, nodes orintersections of road segments, pedestrian segments 904, pedestrianorientation nodes 906 and/or decision points in the image 900. In oneembodiment, the guide points 910 are located at positions on the image900 suitable for guidance information overlays, such as route highlightsand guidance arrows. In one embodiment, guide points are placed at theendpoints of the road or pedestrian segments and at intermediatelocations to provide shape points for the respective segment. In oneembodiment, guide points 910 are placed at the visual end of thesegments in the image 900, and the line-of-sight calculation may be usedto determine placement of the guide points. For example, if a treeobstructs a view of a segment, one guide point is positioned as anendpoint just prior to the tree, and if the segment is visible after thetree, another guide point is placed as an endpoint after the tree. Inanother embodiment, the guide points on either side of the tree mayspecify that any route highlight between these guide points should betransparent so as not to highlight over the tree in the image. The labelpoints 912 are located at positions on the image 900 that correspond tolocations at which label type information may be overlaid on the image900. For example, label points may be located to correspond with pointsof interest, such as the statue 908. In another embodiment, label pointsmay be located to correspond with locations on the image 900 whereadvertisements, addresses, direction (north), icons, place names or anyother information may be overlaid on the image 900.

In one embodiment, the researcher or a technician manually identifiesthe locations of the guide points and label points on the image. Theresearcher or technician digitizes the guide points and label pointsonto the image. The guide points 910 and label points 912 on the image900 provide locations for the guidance information overlays. Forexample, if the geographic overlay is a route highlight to direct a userof the navigation system 100 to follow a road segment, a route highlightmay be drawn connecting the guide points associated road segment in theimage. In one embodiment, the pixels of the image corresponding to theidentified locations for the guide points and label points are coded tofacilitate placement of the overlays. An image is composed of numerouspixels. Each pixel may include one or more bits of overlay informationas is known in the art. For example, the pixel value may have one bit ofoverlay information to support the use of overlays. The one bit ofoverlay information may be used as a toggle bit. Once the toggle bit isset, the pixel is ignored so that an overlay, such as the guidanceinformation overlay, can be placed on the image. In another embodiment,the pixel value may have eight bits of overlay information, which mayallow for variations in transparency between the overlay and the bottomimage. The coding of the overlay pixels for the guide points and labelpoints in the image enable the navigation system 100 to dynamicallyplace several different guidance information overlays, such as a routehighlight, maneuver arrows, direction or labels, on the image.

At step 808, the guide points and label points are associated withgeographic features and/or text labels. For example, the guide pointsthat correspond with a road segment are associated with the respectiveroad segment ID; the guide points that correspond to a node isassociated with the respective node ID; the guide points that correspondwith a pedestrian segment are associated with the respective pedestriansegment ID; the guide point that correspond to an orientation node isassociated with the orientation node ID; the guide point or label pointthat correspond to a point of interest is associated with the respectivepoint of interest. Furthermore, label points are associated withcorresponding text. The image data, guide point and label pointinformation, associated features and labels are then stored in thegeographic database as discussed in greater detail below.

In another embodiment, the steps 804, 806 and 808 are performed byoverlaying vector data representing the geometry of the geographic areaonto the image. Based on the distance visible in the image from the lineof sight determination and the location and direction from which theimage was captured, vector data representing the geometry of thegeographic area visible in the image is obtained from the geographicdatabase 116. For example, if the line of sight for the image is 20meters, a vector data clip corresponding to the 20 meters area visiblein the image is obtained from the geographic database 116. Because theimage is captured at a height above ground surface, the image provides abirds-eye view of the geographic area. To accommodate the birds-eyeperspective, the vector data clip of the geographic area in the image isobliquely projected onto the image. Additionally, the vector data clipmay be appropriately scaled so the overlay of the vector data matchesthe features of the image. The overlaid vector data comprising vectorpoints at nodes and shape points along segments align with theirrespective intersections and paths in the image. The vector data clipincludes segment IDs and node IDs enabling identification of the pathsand intersections visible in the image. Additionally, the image andassociated vector data clip are stored in the geographic database.

IV. Geographic Database with Image Data

The image data collected as described above in conjunction with FIG. 7is included in the geographic database 116 that represents some of thephysical geographic features in the geographic region 202. In theembodiment of FIG. 4, the road segment data record 304 of the geographicdatabase 116 contains an image data record 304(5), and the node datarecord 306(1) and 306(2) of the geographic database 116 also contains animage data record 306(1)(2) and 306(2)(2). In the embodiment of FIG. 5,the pedestrian segment data record 308 of the geographic database 116contains an image data record 308(5), and the orientation node datarecord 310(1) and 310(2) of the geographic database 116 also contains animage data record 310(1)(4) and 310(2)(4). In one embodiment, the imagedata associated with the road segment data record 304, the node datarecord 306, the pedestrian segment data record 308 and/or theorientation node data record 310 are references to image data records1000 as described in conjunction with FIG. 10. Additionally, the roadsegment data record 304, the node data record 306, the pedestriansegment data record 308 and/or the orientation node data record 310 mayeach be associated with several image data records 1000. For example, anode data record 306 representing an intersection of two roads may beassociated with four image data records 1000.

FIG. 10 shows some of the components of an image data record 1000contained in the geographic database 116. The image data record 1000includes an image ID 1000(1) by which the data record can be identifiedin the geographic database 116. Each image data record 1000 hasassociated with it information (such as “attributes”, “fields”, etc.)that describes features of the represented image. The image data record1000 may include data 1000(2) or a feature code that indicates a type ofgeographic feature captured in the respective image, such as a roadsegment, road intersection, pedestrian segment, orientation node, pointof interest, scenic view or any geographic feature of the geographicregion. The image data record 1000 includes data 1000(3) that indicate alocation associated with the image, such as the longitude and latitudecoordinates of the location. The image data record 1000 also includesdata 1000(4) that indicates a direction associated with the image, suchas a direction associated with a control point in the image.

The image data record 1000 includes data 1000(5) enabling the image tobe displayed. Furthermore, the image data record 1000 may includeoverlay data 1000(6) providing data to allow the navigation system 100to create guidance information overlays on the image. In one embodiment,the overlay data 1000(6) identifies overlay pixels corresponding toguide points and label points of the image. Additionally, the overlaydata 1000(6) identifies the overlay pixels that correspond to geographicfeatures, such as road segments, pedestrian segments, nodes andorientation nodes to allow route highlights and maneuver arrows to beoverlaid on the image at locations corresponding to the geographicfeatures. Furthermore, the overlay data 1000(6) may identify overlaypixels corresponding to points of interest or other items in the imagesuitable for guidance information overlays, such as text, advertisingand icons. The overlay data 1000(6) may also indicate the style andinformation included in the guidance information overlay. By identifyingthe pixels in the image, guidance information overlays may be createddynamically by the navigation system 100, which may avoid having tostore multiple copies of the same image. For example, the overlay may bean arrow pointing to a direction to walk, such as the arrow 602 depictedin FIG. 6. As another example, the overlay may be a route highlightcomprising series of dots for the user of the navigation system 100 tofollow. Any other overlay may be used, such as labels and directionindications. In an alternative embodiment, the overlay data 1000(6) maycontain a plurality of established guidance information overlays, suchas route highlights or maneuver arrows associated with road segments orpedestrian segments.

The image data record 1000 may also data 1000(7) indicating a geographicfeature ID or several geographic features associated with the image. Asdiscussed above in conjunction with FIG. 7, the image iscross-referenced with the geographic feature(s). The associatedgeographic feature ID data may be a road segment ID, node ID, pedestriansegment ID, orientation node ID, point of interest ID or a reference toany other geographic feature of the geographic database 116. The imagedata record 1000 may also include other data 1000(8).

In another embodiment, the image data record 1000 includes dataproviding a vector data clip (not shown) corresponding to the photo data1000(5).

V. Guidance Information Overlays on Images

As discussed above in conjunction with FIG. 1, the navigation system 100includes navigation application software programs 110 that provide thevarious navigation features and functions. In one embodiment, thenavigation functions and features may include route calculation 124 androute guidance 126. The route calculation function 124 receives arequest to calculate a route to a desired destination. The request maybe in the form of an identification of a starting location and a desireddestination location. The identification of these locations may includethe geographic coordinates of these locations. The route calculationfunction may also be provided with other data or parameters, such aspreferences (e.g., scenic route, handicap access, or any otherpreference). Given at least the identification of the starting locationand the destination location, the route calculation function 124attempts to determine one or more solution routes between the startinglocation and the destination location. A solution route is formed of aseries of connected road and/or pedestrian segments over which the userof the navigation system 100 can travel from the starting location tothe destination location. When the route calculation function 124calculates a route, it accesses the geographic database 116 and obtainsroad segment data entities 304 and/or pedestrian segment data entities308 that represent segments around and between the starting location andthe destination location. The route calculation function 124 uses theinformation in the road and/or pedestrian segment data entities 304 and308 to attempt to determine at least one valid solution route from thestarting location to the destination location. In determining a validsolution route for the pedestrian to travel, the route calculationprogram 124 uses the data attributes associated with the road and/orpedestrian segment data entities to account for preferences. The routecalculation function 124 may attempt to find solution routes that takesthe least time to travel, that covers the least distance, or that meetssome other specifiable criteria.

The route calculation function 124 may use various means or algorithmsin determining solution routes. Methods for route calculation aredisclosed in U.S. Pat. No. 6,192,314, the entire disclosure of which isincorporated by reference herein. (The methods disclosed in theaforementioned patent represent only some of the ways that routes can becalculated and the claimed subject matter herein is not limited to anyparticular method of route calculation. Any suitable route calculationmethod now known or developed in the future may be employed.)

The route calculation function 124 provides an output. In oneembodiment, the output of the route calculation function 124 is in theform of an ordered list identifying a plurality of road and/orpedestrian segment data entities. The plurality of road and/orpedestrian segment data entities represent the road and/or pedestriansegments that form the continuous navigable route between the startinglocation and the destination that had been calculated by the routecalculation function 124. The route calculation function 124 maycalculate more than one solution route including alternative orderedlists of the plurality of road and/or pedestrian segments.

As discussed above in conjunction with FIG. 1, the navigation system 100includes navigation application software programs 110 that provide thenavigation feature and function of route guidance 126 for the user ofthe navigation system 100. The route guidance function 126 providesdetailed directions for reaching a desired destination. In oneembodiment, the list of road and/or pedestrian segment data entitiesdetermined by the route calculation function 124 is provided to theroute guidance function 126. The route guidance function 126 uses theinformation in the list, as well as additional information from thegeographic database 116, to provide instructions to the end user totravel the route defined by the list output by the route calculationfunction 124. The route guidance function 126 may include functions thatidentify locations along the calculated route at which maneuveringinstructions may be provided to the end user. The route guidancefunction 126 may provide the maneuvering instructions all at once, oralternatively, the route guidance function 126 may provide themaneuvering instructions one at a time as the end user is traveling. Inone embodiment, each maneuvering instruction is provided separately (orin small groups of combined maneuvering instructions) in advance of whenthe specific maneuver is required to be taken so that the end user canprepare to make the required maneuver. The output of the route guidancefunction 126 is provided to the end user through a user interface 114included on the computing platform 102. The output of the route guidancemay be conveyed audibly through speech synthesis or on a visual display.

Methods for providing route guidance using geographic data are disclosedin U.S. Pat. No. 6,199,013, the entire disclosure of which isincorporated herein by reference. (The methods disclosed in theaforementioned patent represent only some of the ways that routeguidance can be calculated and the claimed subject matter herein is notlimited to any particular method of route guidance. Any suitable routeguidance method now known or developed in the future may be employed.)

In order to provide maneuvering instructions at appropriate times and/orlocations, the navigation system 100 uses data from the positioningsystem (112 in FIG. 1). The positioning system 112 determines theposition of the end user (computing platform 102) as he or she istraveling. A positioning (map-matching) function 130 in the navigationprogramming 110 compares the user's position determined by thepositioning system 112 to the positions of the road and/or pedestriansegments represented by the road and/or pedestrian segment data entitiesin the solution route. Using this comparison, the maneuver instructions,which are related to positions along the solution route, can be providedat appropriates times as these positions are approached.

The route guidance function 126 may also provide the end user withinformation about the remaining distance to the destination location.The list of road and/or pedestrian segment data entities from the routecalculation function 124 may also be provided to the map displayfunction 128. The map display function 128 uses the information in thelist, as well as additional information from the geographic database116, to provide graphical maps on a display of the user interface 114.The graphical maps illustrate the areas through which the calculatedroute passes. The path of the calculated route may be highlighted on thedisplayed maps.

In one embodiment, the route guidance function 126 also provides imageswith guidance information overlays. The images with overlays may beprovided in conjunction with maneuver instructions. In an alternativeembodiment, the route guidance function 126 provides an image with aguidance information overlay instead of audio or textual maneuverinstructions. In another embodiment, the route guidance function 126provides an image with a guidance information overlay at variouslocations along the solution route, such as at decision points. In afurther embodiment, the route guidance function 126 provides a series ofimages with guidance information overlays to provide a continuous visualrepresentation of the solution route.

FIG. 11 is a flow chart that depicts the steps performed by the routeguidance function 126 to provide an image with a guidance informationoverlay. At step 1100, the route guidance function 126 determineswhether an image is available in the geographic database 116corresponding to the current location and direction of the navigationsystem 100 as it travels along the solution route provided by the routecalculation function 124. In one embodiment, the route guidance function126 references the road segment data record 304, node data record 306,pedestrian segment data record 308 and/or orientation node data record310 corresponding to the current location of the navigation system 100to determine whether an image data record 1000 exists. In oneembodiment, the determination includes whether an appropriate imagebased on the direction of travel and/or time of day is available fromthe reference image data record 1000. At step 1102, the route guidancefunction 126 determines whether to present the image to the user of thenavigation system 100 via the user interface 114. In one embodiment, thenavigation system 100 provides images only when requested by the user ofthe navigation system 100. For example, the user may request the imagesusing the user interface 114. In another embodiment, the navigationsystem 100 provides images automatically at every decision point alongthe calculated route.

At step 1104, the route guidance function 126 determines an appropriateguidance information overlay. The guidance information overlay may be amaneuver arrow, a line or plurality of dots highlighting the solutionroute or alternate routes, text labels, direction labels or any otherinformation. The route guidance function 126 may obtain data from theimage data record 1000 indicating the overlay pixels corresponding tothe road segments, pedestrian segments, nodes and/or orientations nodescomprising the current portion of the route. Additionally, the routeguidance function 126 may select appropriate guidance overlays to placeat the overlay pixels. For example, if the driving direction is a rightturn onto a road segment at the next intersection, the route guidancefunction 126 selects the guidance information overlay that provides amaneuver arrow for turning right onto the road segment on the associatedimage. At step 1106, the image with the guidance information overlay iscreated. FIGS. 6, 12-15 will be used to illustrate embodiments of theimage with guidance information overlay.

FIG. 6 illustrates one embodiment of the guidance information overlay ofa maneuver arrow 602. The image 600 is a 360-degree panoramic photographof a road node. The image 600 include the guidance information overlayof the maneuver arrow 602 indicating a direction of travel or turnrequired from the current location onto a connected road segment tofollow the solution route. The 360-degree panoramic photograph 600 helpsto orient the user of the navigation system 100 and may be especiallyhelpful to a pedestrian. The guidance information overlay of themaneuver arrow 602 directs the user to turn onto an indicated roadsegment that the user may more readily identify by comparing thefeatures in the image 600 to their visible surroundings. Additionally,the maneuver arrow 602 may be any color; the color may be chosen in amanner such that the user quickly notices the guidance informationoverlay 602. While FIG. 6 depicts a 360-degree photograph, the image maybe a single-view photograph.

In another embodiment, the guidance information overlay includes a label604 indicating a visible point of interest along the calculated route.As shown in FIG. 6, the label 604 indicates a “bank” is along thesolution route. In other embodiments, the label may be associated anyother point of interest visible to the user from the solution route.Furthermore, the label 604 may be an icon indicating the type of pointof interest, a description of the point of interest, a name of the pointof interest or any other information regarding the point of interest.The label 604 provides supplemental guidance information to the user andmay be used to confirm that the user is following the calculated route.Additionally, guidance information overlay may comprise labels for otherpoints of interests or features in the image to help orientate the user.For example, the guidance information overlay may comprise a labelidentifying a readily visible landmark such as a communications tower.In one embodiment, the guidance information overlay is a labelindicating a direction. In another embodiment, the overlay may comprisean advertisement associated with a business visible in the image 600 ora business located close to the area of the image 600.

FIG. 12 illustrates another embodiment of the guidance informationoverlay. The image 1200 in FIG. 12 is a 360-degree photograph. Theguidance information overlay is a route highlight as depicted with aplurality of dots or “bread crumbs.” A first series of dots 1202 areused depict the portion of the solution route that has been traveled anda second series of dots 1204 are used to depict the next road and/orpedestrian segment(s) of the solution route. The dots 1204 allow theuser to visually identify the next portion of the route on the image1200 and visually orient him or her in the geographic region using theimage and guidance information overlay. While dots are used in FIG. 12,any route highlight may be used such as a series of arrows, a solid line1206, a dash line or any other shape. The first and second series ofdots 1202 and 1204 may be different colors to distinguish the twoportions of the solution route. As seen in FIG. 12, the dots closest tothe pedestrian may appear larger than the dots further away. Theinterval and size of the dots is described with more detail withreference to FIG. 13.

FIG. 13 is a pictorial representation 1300 of guidance informationoverlay comprising the series of dots, according to an exemplaryembodiment. Dot 1302 may indicate a location at which the image wascaptured. Additionally, the dot 1302 may be used to represent thelocation of the user in the image, such as a “you are here” guidanceinformation overlay on the image. As the distance 1304 from the dot 1302increases, the size of the dots may decrease proportionally. Theinterval and scale of the dots may be selected to provide adequateconnectivity for guidance and may be based on the line-of-sightcalculation.

FIG. 14 illustrates another embodiment of the guidance informationoverlay. FIG. 14 is a single-view image 1400 depicting a guidanceinformation overlay that shows alternative routes, according to anexemplary embodiment. As mentioned above, the route calculation function124 may calculate several route solutions between the origin anddestination. These route solutions may comprise some of the same roadand/or pedestrian segments while including different segments. The oneor more alternative routes may vary in time or distance of travel, butthe alternative routes may have different features that may beattractive to a user. For example, alternative routes may be morescenic, have a flatter grade, be well lit at night, handicappedaccessible and so on.

Referring to FIG. 14, the guidance information overlay includes a routehighlight represented by a first series of dots 1402 depicting a firstroute and a route highlight represented by second series of dots 1404depicting a second route. The first and second series of dots 1402 and1404 may be different colors to distinguish the two routes. The firstseries of dots 1402 highlights a main route, while the second series ofdots 1404 highlights an alternative route. The guidance informationoverlay provides the user an option to follow either route highlight1402 or 1404 around the fountain. For example, the user may select thesecond route 1404 because it is tree-lined, which may provide moreshade. While, this embodiment is depicted using two routes, the numberof routes may be more than two. Further, the route highlights 1402 and1404 may also overlay road segments 210 in a road network 208.

In another embodiment, the guidance information overlays conveyadditional information about the respective depicted alternative routes.FIG. 15 is a single view image 1500 including guidance informationoverlays to show alternative routes, according to another exemplaryembodiment. In this example, the guidance information overlay includes aroute highlight represented by a first series of dots 1502 depicting afirst route and a route highlight represented by a second series of dots1504 depicting a second route. The first series of dots 1502 mayhighlight a more direct route containing steps, while the second seriesof dots 1504 may highlight an alternative route that is handicappedaccessible. The second series of dots 1504 includes a handicap icon oneach of the dots, which describes a feature of the alternative route1504. The route guidance overlay of the route highlight with handicapicon visually provides useful information to the user of the navigationsystem 100. For example, the route highlight with the handicap icon maydirect the user to a handicapped accessible entrance to a building.Additionally, the user may be pushing a stroller, wearing roller skates,or have a medical condition that makes it difficult to traverse theroute highlight 1502 having stairs.

While FIG. 15 depicts the use of a handicap icon in the guidanceinformation overlay, a variety of other symbols or icons may be used tohighlight the features of a particular route. For example, a tree symboloverlay may be used to identify a tree-lined pathway; a water fountainicon or toilet icon may be used to identify a route that passes by awater fountain or toilets, respectively; and icons or symbols may beused to identify well-lit route, quiet route, scenic route, crowdedroute, peaceful route, bicycle friendly route, or any other feature. Theroute guidance function 126 may include the appropriate symbol or iconcorresponding to the features of the solution route.

Referring again to FIG. 11, after the image with guidance informationoverlay is created, the user of the navigation system 100 is presentedthe image with guidance information overlay via the user interface 114.FIG. 16 is a screen shot 1600 of the user interface 114 depicting animage 1602 with guidance information overlays 1604 and 1606, accordingto an exemplary embodiment. The image 1602 with the guidance informationoverlays 1604 and 1606 orients the user and provides reassurance thatthe user is correctly following the solution route to the destination.The user may obtain guidance messages (textual or audio) or a map bytouching the message icon or the map icon depicted in the screen shot1600.

FIG. 17 illustrates another embodiment for presenting the image withguidance information overlay to the user. FIG. 17 is a screen shot 1700of a user interface 114 that provides an image 1702 with guidanceinformation overlay 1704 of a route highlight and a textual guidancemessage 1706. In the example depicted in FIG. 17, user interface 114provides the image 1702 of what the pedestrian will see as traveling thesolution route, the guidance information overlay 1704 visually directsthe user along the route and the textual guidance message 1706 describesthe path. In one embodiment, the image 1702 includes labels 1708identifying features referenced in the textual guidance message, such as“Lake Michigan.”

FIGS. 18A and 18B illustrate a further embodiment for presenting theimage with guidance information overlay to the user. FIG. 18A is ascreen shot 1800 of an image 1802 with a guidance information overlayand a touch-screen icon 1804 for requesting the display of a textualguidance message, while FIG. 18B is a screen shot 1806 of a textualguidance message 1808 and a touch-screen icon 1810 for requesting thedisplay of an image. FIGS. 18A and 18B include the same image 1702 withguidance information overlay and textual guidance message 1706 asdepicted in FIG. 17; however, in this example, the image 1802 and theguidance message 1808 are shown on different screens. The user may usethe touch-screen icons 1804, 1810 to toggle between the photograph 1802and the pedestrian guidance message 1808. While this example uses atouch-screen input mechanism to the user interface 114, any other inputmechanism to the user device may be used.

The screen shots 1600, 1700, 1800 and 1806 have been depicted on apersonal digital assistant; however, other user devices, such as acellular telephone, a vehicle navigation system, and a computer may alsobe used to display the images and associated guidance informationoverlays. Further, a user may obtain the images and associated guidanceinformation overlays prior to traveling the solution route. As anotherexample, a person may obtain the images from a stationary computer,which may be printed and taken with the user. As yet another example,the user may obtain the images with the guidance information overlaysfrom a public-access device, such as an Internet web site, a computerterminal, or a kiosk. Additionally, the user may take a virtual tour ofthe solution route using the images obtained prior to traveling.

VI. Alternative Implementation with Information Overlays on Images

The above description presented images with guidance informationoverlays for guiding a user of a navigation system 100 along a solutionroute to a desired destination. FIG. 19 illustrates anotherimplementation of the images with information overlays. FIG. 19 is ascenic image 1900 including label overlays 1902, according to anexemplary embodiment. The label overlays identify popular locations inthe cityscape image 1900. As illustrated in FIG. 19, the informationoverlays include text labels identifying the names of a variety ofbuildings in the image 1900. In addition to labels for buildings, theimage may include labels for any point of interest or geographic featurein the image. In another embodiment, the information overlays maycomprise addresses corresponding to the buildings. In yet anotherembodiment, the information overlays may comprise historical, touristtype or advertisement labels. A user may use the information overlays ofthe image for entertainment purposes. The information overlays may allowthe user to identify important building and structures, which may be ofinterest to tourists, architects, and the like.

In one embodiment, the navigation system 100 presents the image 1900with label overlays 1902 on the user interface 114 for the user to entera location. The user may select a label or building on the image 1900 toenter as his or her desired location. For example, if the user device isa PDA, the pedestrian may select a label by touching a touch-screendisplay using a stylus. In another embodiment, the user may enter thelabel name via the user interface as the desired location.

In one embodiment, the user may use the image 1900 to enter a desireddestination. As discussed above in conjunction with FIG. 1, thenavigation system 100 includes the route calculation function 124. Theroute calculation function 124 receives a request to calculate a routeto a desired destination. The request may be in the form of a request toenter a destination using an image with information overlays. The useris then presented with the image with information overlays. For example,a tourist in Chicago may request to enter a destination using the scenicimage 1900 and the navigation system provides the user with the image1900. The user selects a destination using the image 1900, and the routecalculation function 124 uses the entered destination to calculate asolution route from the current location of the user to the entereddestination. In another embodiment, the user enters the startinglocation for the route using the image 1900. For example, a touristkiosk provides the image 1900 and enables users to determine routes fromand to various destinations. After the starting location and destinationlocation have been entered, the route calculation function 124 attemptsto determine one or more solution routes between the starting locationand the destination location as described above. Additionally, thenavigation system 100 provides route guidance functions and features forthe solution route to guide the user along the solution route to theentered desired destination. The route guidance may comprise images withguidance information overlays, textual messages or any other guidanceinformation. Additionally, the navigation system 100 may provide a mapdisplay to the user.

Additionally, the image 1900 may be used to enter a location for anynavigation feature and function. In another embodiment, the user may usethe image 1900 to enter a desired point of interest to requestinformation about the point of interest. For example, the user mayrequest information about businesses, times of operation, telephonenumbers and any other information. Furthermore, the label overlays 1902of the image may contain advertisements.

It is intended that the foregoing detailed description be regarded asillustrative rather than limiting and that it is understood that thefollowing claims including all equivalents are intended to define thescope of the invention

1. A method of operating a navigation system comprising: determining aroute between an origin and a destination; providing a photographicimage showing a geographic area through which said route passes, whereinsaid photographic image shows the geographic area from a land-basedviewpoint; identifying a business visible in the photographic image;obtaining an advertisement from a database stored on a computer readablemedium for the identified business visible in the photographic image;identifying, in the photographic image, a point of interest separatefrom advertisement for the business visible in the photographic image;providing a route highlight on said photographic image identifying apath corresponding to the route; providing a label associated with thepoint of interest on said photographic image; and providing theadvertisement on said photographic image at a location of the businessvisible in the photographic image.
 2. The method of claim 1 wherein theadvertisement is a text or an icon.
 3. The method of claim 1 wherein theadvertisement has a predetermined transparency.
 4. The method of claim 1wherein the advertisement is placed at a pixel associated with thebusiness visible in the image.
 5. The method of claim 1 wherein thephotographic image is a panoramic image.
 6. The method of claim 1wherein the photographic image provides an angle of view of 360 degrees.7. The method of claim 1 wherein said photographic image is associatedwith location information in the database.
 8. The method of claim 1further comprising: providing information regarding the business basedon a selection of the advertisement by an end user.
 9. The method ofclaim 1 wherein the step of providing the advertisement on saidphotographic image accesses data from the indicating a location of thebusiness in the photographic image.
 10. A navigation system comprising:a processor; a database stored on a computer readable medium; and anapplication executable on said processor to obtain a photographic imagefrom the database, to identify a business visible in the photographicimage, to identify a point of interest visible in the photographicimage, to overlay a route highlight on the photographic image, tooverlay a label on the photographic image for the point of interest, andto overlay an advertisement on the photographic image for the identifiedbusiness visible in the photographic image, wherein the photographicimage provides a land-based view.
 11. The system of claim 10 wherein theadvertisement has a predetermined transparency.
 12. The system of claim10 wherein the photographic image provides an angle of view of 360degrees.
 13. The system of claim 10 wherein said photographic image isassociated with location information in the database.
 14. The system ofclaim 10 wherein the advertisement is an icon.
 15. The system of claim10 wherein the application provides information regarding the businessvisible in the photographic image based on a selection of theadvertisement by an end user.
 16. A method of operating a system thatprovides navigation-related services, the method comprising: providing aphotographic image showing a geographic area from a land-basedviewpoint, wherein a plurality of businesses are visible in thephotographic image; obtaining an advertisement label from a databasestored on a computer readable medium corresponding to a first businessvisible in the photographic image; obtaining a point of interest labelfrom the database corresponding to a second business visible in thephotographic image; placing the advertisement label on said photographicimage for the first business visible in the photographic image; andplacing the point of interest label on said photographic image for thesecond business visible in the photographic image.
 17. The method ofclaim 16 wherein the advertisement label is placed at a label locationassociated with the business visible in the image.
 18. The method ofclaim 16 wherein the advertisement label is placed at a location of thebusiness visible in the image.
 19. The method of claim 16 furthercomprising: providing information regarding the business visible in thephotographic image based on a selection of the advertisement label by anend user.
 20. The method of claim 1, wherein at least one pixel of thephotographic image includes multiple bits of overlay information toallow for variations in transparency between the photographic image andthe point of interest label or advertisement label.